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OBJECT-BASED CODING AND DECODING APPARATUSES AND METHODS FOR 
CL BACKGROUND OF THE INVENTION C-^^-t^^^rf^^^^-^^— • 

5 

p-V"^ d--^ Faeld of the Invention 

^ The present invention relates to image signal compression 

LJ 

43 coding and decoding^ and more particularly to an apparatus for and 

m3 a method of coding image signals, wherein upon scanning transform 

Cy 10 coefficients of an input image signal in a shape-adaptive 

transform coding, only segments containing such shape-adaptive 
transform coefficients are scanned, thereby reducing the 
quantity of data being transmitted. The present invention also 
relates to an apparatus for and a method of decoding image signals, 
15 wherein an inverse scanning for transform coefficients of a 

bitstream encoded in the above-mentioned manner xs carried out 
upon decoding the bitstream, taking into consideration only 
segments containing those transform coefficients. 



p ^1^0^^ Description of the Prior Art 

- P Compression coding and decoding of image signals makes it 
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possible to achieve transmission of image information while 
reducing the memory capacity required to store image signals. 
Thus, sach compression coding and decoding techniques are very 
important techniques in multimedia industries involving 
5 applications such as storage and transmission of image signals. 
Meanwhile, a standardization for information compression 
schemes has been necessary for extension of multimedia 
industries and information compatibility. To this end, various 
image standardization schemes associated with a variety of 
41 10 applications have been proposed. For example, as representative 
= image coding and decoding standardisation schemes, there are 

y- H.2 61 of International Telecommunication Union 

! = 

45 Telecommunication Standardization Sector (ITU-T, the successor 

US of CCITT) for video phone or video conference services using 

15 integrated services digital networks (ISDN), and H.263 of ITU- 
T for transmission of video information using public switched 
telephone networks (PSTN), MPEG^l proposed by Moving Picture 
Experts Group (MPEG) of International Standardisation 
Organxzat ion/ International Electrotechnical Commission Joint 
20 Technical Committee 1/Sub Committee 29/Working Group 11 (ISO/IEC 

JTC1/SC29/WG11) for storage media, and MPEG-2 for high quality 
digital broadcasting associated with high definition 

-2- 



televisions (HDTV) and enhanced digital television (EDTV) . 
Standardization for compressive coding of still image signals 
also has been made by, for example. Joint Photographic Coding 
Experts Group (JPEG) of ISO/IEC JTCX/SC29/WG1 . 

In most conventional iitiage signal coding schemes, the 
entire segment of a rectangular frame or picture is encoded. 
Such schemes are called "frame-based coding". In such xmage 
signal coding schemes, texture information of all pixels 
included m a frame/ namely/ luminance and chrominance, is 
encoded and transmitted. 

Recently, the demands for multimedia products have been 
increased which have functions of coding or manipulating only 
particular regions - or object - of a frame interested or needed 
to the user without coding the entire region of the frame. To 
this end, active research has recently been conducted for 
object-based coding schemes adapted to encode only arbitrary 
shape region of a frame, as a substitute for frame-based coding 
schemes adapted to encode the entire region of a frame. Figs. 1 
and 2 illustrate test images for explanation of such an 
obiect-based coding scheme, respectively. Fig* 1 is a frame 
showing features of two children playing with a ball in an 
arbitrary space (background) . Where information, only 
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associated with the children and ball, of the image is to be 
encoded and transmitted coding of such information can be 
achieved using the object-based coding scheme, that is, only- 
texture information values of pixels associated with the 
children and ball are encoded and transmitted. In this case, the 
regions respectively associated with the children and ball are 
designated to be an object, whereas the remaining region of the 
picture other than the object is considered to be a background. 

For coding of the picture shown in Fig . 1 using the 
ob:i ect-based coding scheme, all pixels included in the frame 
should be distinguished into those associated with the children 
and ball and those associated with the background m an encoder 
and a decoder. This information is referred as shape information 
of the object. In order to allow the decoder to recognize the 
shape information, the encoder should efficiently encode the 
shape information and then transmit the shape information to the 
decoder. For thus, the object-based encoder and decoder have a 
most remarkable difference from the frame-based encoder and 
decoder in that they include a shape information encoder and a 
shape information decoder, respectively. 

Fig- 2 shows shape information included m the image 
Information where only the children and ball are considered to be 
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an. object . In this case, the pixels associated with the children 
and ball have shape information bearing a bright value whereas the 
pixels associated with the background have shape information 
bearing a dark value. Such shape information of pixels assigned 
With different values to distinguish those of the pixels 
associated with the object from those associated with the 
background is called a "binary mask" . Shape information may also 
be expressed by a contour indicative of the boundary between the 
background and the object. A transformation can be made between 
the shape information in the form of a binary mask and the shape 
information in the form of a contour* That is, the shape 
information having the form of a binary mask can be expressed into 
contour information by carrying out a contour extraction . On the 
other hand, a contour filling is carried out for obtaining a 
binary mask from contour information. 

Representative examples of frame-based coding schemes 
include H.261 and H-263 of ITU-T, MPEG-1 and HPEG-2 of ISO/IEC 
JTC1/SC29/WG11, and JPEG of ISO/IEC JTC1/SC2 all being 
standardized schemes. On the other hand, representative 
examples of object-based coding schemes include WPEG-^ of 
ISO/IEC JTC1/SC29/WG11 and JPEG2000 of ISO/IEC JTCl /SC2 9/WGl 1 . 

Transform coding is the most widely used coding method in 
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well-known compressive coding schemes for image signals. In 
such a transform coding, an image signal is transformed to 
transform coefficients - or frequency coefficients and low 
frequency components are mainly transmitted while suppressing 
transmission of high frequency components. This scheme has an 
advantage of a high compression ratio while minimizing the 
degradation of picture quality. Examples of such a transform 
coding scheme include a discrete Fourier transform (DFT) , a 
discrete cosine transform (DCT) , a discrete sine transform (DST) , 
and a Walsh-Hadamard transform (WHT) . 

Of such transform schemes, DCT is a scheme providing a 
superior compactness of image signal energy on low-frequency 
components. In other words, DCT provides a superior picture 
quality over other transform schemes, in spite of only using a 
reduced number of low frequency transform coefficients- In 
addition, there is a fast algorithm for DCT. By virtue of such an 
adv^antage, DCT has been used in various image coding 
standardization schemes such as H,261, H.263, MPEG^l, MPEG^Z, 
MPEG-4, and JPEG. 

Research of such transform coding schemes has been made with 
respect to image signals in blocks each consisting of a set of 

"6- 
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pxxels (picture elements or pels) with a certain size. In 
accordance with. transform coding schemes developed, a 
rectangular frame is divided into a plurality of blocks having the 
same size . A transform coding is then carried out for each block. 
In the case of an object-based coding scheme only texture 
information included in objects is encoded, as compared to 
frame-based coding scheme in which texture information of all 
pixels included in a rectangular frame is completely encoded. In 
such an object-based coding scheme, accordingly^ at is required 
to conduct a transform coding only for image signal of some pixels 
of blocks associated to the object . Fig. 3 illustrates an object 
having an arbitrary shape in a frame divided into a plurality of 
blocks. In Fig, 3, each square region is indicative of one block. 

Dark region is indicative of a set of pixels associated with the 
object. In Fig. 4, transparent blocks correspond to blocks of 
Fig. 3 not to be encoded because of including no object pixel, 
respectively. The black blocks of Fig. 4 are indicative of 
blocks which are to be transformed by one of the known transform 
coding schemes because all pixels thereof are object pixels . The 
gray blocks of Fig . 4 are indicative of blocks each including both 
the object pixels and the non-object pixels, thereby requiring a 
transform coding only for texture information of a part of pixels 
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thereof. In the following description, blocks corresponding to 
such gray blocks are referred to as "boundary blocks". This 
scheme, in which a transform coding is not conducted for the 
entire pixels of each square block, but conducted for a part of 
pixels included in each square block, is called a "shape-adaptive 
transform coding". 

In a representative shape-adaptive transform coding scheme, 
each block which is a coding unit consists of 8x6 pixels . Namely, 
blocks include 8 lines per block and 8 pixels per line. In 
accordance with the scheme, texture signal of object pixels to be 
encoded are processed by an one-dimensional DCT in a vertical 
direction and then in a horizontal direction. 

Referring to Fig. 5A, an 8x8 block is illustrated which has an 
object region to be encoded. In Fig. 5A, gray pixels are pixels 
associated with objects. For processing an shape-adaptive DCT 
coding for texture signal of object pixels to be encoded, a 
re-arrangement of pixels is carried out by vertically shifting 
those object pixels to the upper border of the block, thereby 
filling that border, as shown in Fig. 5B. In this state, one- 
dimensional DCT is performed in a vertical direction (indicated 
by thick lines in Fig. 5) for texture information of each column 
including object pixels. As a result, transform coefficients of 



-8- 




11-13 17:29 WED FROM: PHOENIX INTEI 




82-2-555-1377 



10:542891 



PRGE:09 



42 



m 10 

J3 



15 



one-dimensional DCT are generated, as shown in Fig. 5C- The 
solid circles in Fig, 5C denote positions of mean values of 
vertical one-dimensional DCT, namely, direct current (DC) values, 
respectively. After completing the vertical one-dimensional 
DCT as shown in Fig. 5D, a pixel re-arrangement is conducted again 
by shifting again the object pixels to the left border of the block. 

Thereafter, one-diiaensional DCT is performed in a horizontal 
dxrection for the transform coefficients included in each of rows, 
which comprise at least one transform coefficient, as shown in Fig, 
5E, Fig. 5F shows positions of transform coefficients 
completing the one-dimensional DCT in both the vertical and 
horizontal directions. This procedure, namely, the transform, 
in which one directional DCT is carried out in a successive manner 
in the vertical and horizontal directions, is called a "shape- 
adaptive DCT". It should be noted that the positions of 
transform coefficients resulting from the shape-adaptive DCT may 
not be coincide with those of input object pixels (or input shape 
information) and that the positions of those transform 
coefficients are determined only based on the input shape 
information. The number of transform coefficients resulting 
from the shape-adaptive DCT is equal to the number cf object 
pixels, as in the conventional block-wised DCT schemes . 
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Fig. 6 illustrates a block diagram of a conventional 
Shape-adaptive image signal coding apparatus (=texture 
information encoding part 24) which utilizes the above 
mentioned shape-adaptive DCT* This apparatus 24 receives, as an 
input thereof, shape information on a block basis having a MxN 
size (M and N are integer values larger than zero) and texture 
information of object pixels in the form of a block having the same 
size as the shape information block. In the case of Figs. 5A to 
5F, block of M=8 and N=8 is inputted- The apparatus 24 generates 
an output in the form of a bitstream. The outputted bitstream is 
transmitted to a receiver. Otherwise, the bitstream may be 
transmitted to a multiplexer (MUX) so that it is multiplexed with 
other signals, for example, bitstreams of shape information. 

An shape-adaptive DCT part 10 first performs a shape- 
adaptive DCT for input texture information of object pixels, 
based on input shape information, thereby outputting transform 
coefficients which are positioned at the upper left portion of an 
associated block, as shown in Fig. 5F. For these transform 
coefficients, a quantization is conducted for data compression 
in a quantization part 11. As a result, quantized transform 
coefficients are outputted from the quantization part 11, The 

-10- 
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transform coefficients from the quantization part 11 are then 
transmitted to a scanning part 12 which, in turn, carries out a 
scanning procedure for arranging the received transform 
coefficients into a one-dimensional array. Various scanning 
metHods applicable to blocks of M=8 and N=8 are illustrated in 
Figs. 7Ato7C. Fig. 7A illustrates a zig- zag scanning order most 
widely used. In Fig. the numerals indicated on respective 

portions of the block are indicative of the scanning order of 
corresponding transform coefficients upon arranging those 
transform coefficients in a one-dimensional array. The scanning 
methods of Figs. 7A to 7C can be selectively used in accordance 
with the characteristics of input image signals to be subjected 
to a transform coding. These scanning methods are also used in 
m:peG-2 and schemes* Blocks, which are processed by the 

shape-adaptive DCT^ may include segments containing no transform 
coefficient, as shown in Fig. 5F. In accordance with a 
conventional schemes, a scanning operation is carried out for the 
entire segment of a block in a sequential manner according to a 
well-known, predetermined scanning order while setting 
transform coefficient values of segments containing no transform 
coefficient to "zero"* That is, all segments - 64 transform 
coefficients in the case of an 8x8 block - are sequentially 
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scanned using one of the known scanning methods, irrespective of 
whether or not the segments to be scanned contain transform 
coefficients- The resultant transform coefficients arranged 

in a one-dimensional array are subjected to a variable-length 
coding in a variable-length coding part 13 . The resultant signal 
in the form of a bitstream is then transmitted to an MUX or 
receiver - 

The variable-length coding part 13 receives, as an input 
thereof, the DOT coefficients outputted from the scanning part 12 
and carries out a variable-length coding for the transform 
coefficients arranged in a one-dimensional array xn a sequential 
manner - 

Now, the variable-length coding for transform coefficients 
will be described in conjunction with H, 2 63 which is a 
representative of conventional variable-length coding schemes. 

In accordance with this scheme, EVENTS of transform coefficients 
with values not being "zero" are first derived- For the derive 
EVENTS, corresponding bitstreams are then sought from a given 
variable-length coding (VLC) table. Thereafter, the sought 
codes are sequentially outputted. Each EVENT consists of a 
coTObination of three kinds of information, namely, a LAST 
indicative of whether or not the transform coefficient being 



-12- 




11-18 17:30 WED FROM: PHOENIX INTi 



82-2-555- 13TT 



TO: 542891 



F»ftGE:13 



m 10 



■:iQ 



carrently encoded is the last non-zero transform coefficient, a 
RUN indicative of the number of successive zero tran3form 
coeffxcients preceding the current non-zero coefficient and a 
LEVEL indicative of the magnitude of the current transform 
coefficient . 

Such EVENTS, which are combined and defined as mentioned 

above, can be entropy-coded through a variable-length coding 

such as Huffman coding or arithmetic coding. This is, a smaller 

amount of bits are allocated for EVENTS exhibiting a higher 

occurrence probability. On the other hand, a larger coaount of 

bats are allocated for EVENTS exhibiting a lower occurrence 

probability. Accordingly, it is possible to achieve coding of 

EVENTS using a considerably reduced number of bits, as compared 

to a fixed-length coding (FLC) . 

Apart of a VLC table that used for H.263. is illustrated in 
Table 1- 
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□□ULinDDDDDlGDDDQIXEiDDDODmmiXODDDaQQUDnraQaGum 
INDEX LAST RUN LEVEL BIT VLC CODE 

LunDDDDmGanDGanDDDDLXinDDDDGDnamDmaEiTincE 
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Os 
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11 
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11 


0000 1000 
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10 


12 


0000 0000 
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10 
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11 


12 


0000 0000 
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11 
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12 


12 
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12 
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^ In the Table 1, the first column represents indexes for 
distinguishing EVENTS from one another. The second column 
represents LASTS- LAST=^0 denotes that coefficient to be coded 
is not the last non-zero transform coefficient whereas LAST=1 
denotes that the coefficient is the last one. The third column 
represents RUNs . The fourth column represents LEVELs indicative 
in 10 of values of transform coefficients- The fifth column 
Q represents the number of bits generated for each EVENT. The last 

n column represents a bitstream generated for each EVENT. In the 

last coliimn, "s" is indicative of the sign of each LEVEL. A s 
ly of "0" (s = 0) is indicative of the fact that the associated LEVEL 

15 is a positive number whereas a s of "1" (s = 1) is indicative of 
the fact that the associated LEVEL is a negative number. 

With regard to the occurrence probability of EVENTS, it 
should be noted that EVENTS exhibit a lower occurrence 
probability at greater RUN values and a higher occurrence 
20 probability at smaller RUN values. Where the variable-length 
coding is conducted, taking RUNs into consideration, accordingly, 
a larger amount of bits are allocated for an EVENT with a greater 
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RUN valae whereas a smaller amount of bits are allocated for an 
EVENT with a smaller RUN value. Referring to the VLC table of 
263 a3 shown in Table 1^ such a feature can be clearly understood. 
This will be exemplarily described in conjunction with EVENTs 
5 (INDEX -1, 13, 19) respectively having RUNS of 0, 1, 2, along with 
LAST - 0 and LEVEL 2. For the EVENT bearing INDEX = 19 (LAST 
= 0, RUN =2, andLEVEL = 2), nine bits are allocated , Seven bits 
;g are allocated for the EVENT bearing INDEX = 13 (LAST = 0, RUN = 

[q 1, and LEVEL = 2) • On the other hand, five bits are allocated for 

[g 10 the EVENT bearing INDEX = 1 {LAST - 0, RUN == 0, and LEVEL = 2) . 
i^j Thus, a larger ajtiount of bits are allocated at a greater RUN value 

LUider the condition in which the LAST and LEVEL oalues are fixed. 

: . 

lO p 

-0 [ Known shape-adaptive DCT coding schemes may use the above 

mentioned transform coefficient VLC method or VLC table. This 
15 will be exemplarily described in conjunction with Figs . 8A to 8E . 

Fig. 8A shows the result obtained after carrying out a shape- 
adaptive DCT and quantization for an image signal j.n the form of 
an 8x8 block. In Fig- 8A, the dark segments correspond to object 
pixels of the block, respectively. Accordingly, the dark 
20 segments correspond to segments containing transform 
coefficients generated due to the object pixels. The remaining 
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bright segments are indicative of segments containing no 
transform coefficient, thereby being set with a transform 
coefficient value of "0" . In each dark segment, "Xi j " represents 
a transform coefficient positioned at an i-th position in a 
5 horizontal direction and a j-th position in a vertical direction 
in 8x8 block. When all transform coefficients of the block are 
scanned in a zig-zag scanning order, they are arranged m the 
order of Xll, X12, X21, X31, X22, X13, X14, 0, X32, KQX, K51, X42, 
0, 0, X15, X16, 0, 0, 0, X52, X61, X71, 0, 0, . . and 0. If the 



,ia 10 transform coefficient X71 is not zero, then the variable-length 



coding can be carried out only for segments positioned within the 
region defined by the thick solid line of Fig. 8B. Fig. 8C 
illustrates the case in which two transform coefficients X32 and 
X42 are zero whereas the remaining transform coefficients having 



15 non-zero values, respectively. When the transform coefficient 
X41 is encoded in this case, its LAST value is zero because it is 
not the last one of non-2ero transform coefficients in the block. 
In this case, LEVEL and RUN values are X41 and 2, respectively. 
With regard to the transform coefficient X41, such an increase 
20 in RUN value caused by the transform coefficient X32 having a 
value of zero is reasonable because the zero v/alue of the 
transform coefficient X32 is generated in accordance with a 
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signal information of associated object . However/ the transform 
coefficient value of zero existing between the transform 
coefficients X14 and X32 is a value not generated in accordance 
w:i th the object information transform, but given for a segment 



transmission of such information is unnecessary and rather 
results in an increase in RUN value. As a result, there is a 
disadvantage in that an increased number of bits is generated. 

Thas causes a reduction of the coding efficiency of the 
shape-adaptive DCT coding . 

Although problems involved in the conventional shape- 
adaptive DCT coding, which is a representat i\/e shape-adaptive 
transform coding scheme, have been described, other shape- 
adaptive transform coding schemes also have the same problems. 

That is, the conventional shape-adaptive transform coding 
schemes have a problem in that an addition of unnecessary values 
of zero is involved in the scanning procedure. 

Meanwhile, a variety of vlc coding schemes for carrying out 
a VLC for transform coefficients have been used. Although the 
VLC table of H,2 63 has been exemplified in the above description^ 
a VLC table consisting of a combination of only RUN and LEVEL is 
used in the cases of JPEG, MPEG-1, and MPEG-2 . In this case. 



containing 



no 



transform 



coefficient . 



Accordingly, 
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however, the above mentioned problem namely , reduction of coding 
efficiency, also occurs because an increase in RUN value results 
in an increase in the number of coding bits occurs. 

SUMHARY OF THE INVENTION 

P Therefore, an object of the invention is to overcome the 
above mentioned problems and to provide an object-based coding 
apparatus and method for image signals/ wherein upon scanning 
shape-adaptive transform coefficients of an input image signal 
transformed in accordance with a shape-adaptive transform for an 
object-based coding thereof, only segments containing such 
shape-adaptive transform coefficients are scanned, thereby 
reducing the quantity of data being encoded. 

Another object of the invention is to provide an object- 
based decoding apparatus and method for image signals capable of 
effectively decoding image data transmitted after being encoded 
in accordance with a coding method of the present invention. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Other objects and aspects of the invention will become 
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apparent from the following description of embodiments with 
reference to the accompanying drawings in which: 

1^ Fig. 1 is a view illustrating a test image for explanation 
of an object-based coding scheme; 

P Fig. 2 is a view illustrating the shape information of the 
test image shown in Fig. 1; 

Fig, 3 is a schematic view illustrating object blocks for a 
shape-adaptive transform coding; 
p Fig. 4 is a schematic view for explanation of the shape- 
10 adaptive transform coding for each block of Fig. 3; 
iTj Figs. 5A to 5F are schematic views respectively 

ll illustrating successive steps involved in a general shape- 

adaptive DCT procedure; 

if; 

S Fig. 6 is a block diagram illustrating a conventional 

jJJ 

15 shape-adaptive image signal coding apparatus; 

Figs. 7A to 7C are schematic views for explanation of 
scanning methods to which the present invention is applicable, 
respectively; 

Figs. 8A to 8E are schematic views for explanation of a VLC 
20 method for quantized transform coefficients, respectively; 

Fig- 9 is a block diagram illustrating an objects-based image 
signal encoder according to the present invention; 
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Fig. 10 is a block diagram illustrating an object coding unit 
according to the present inventions- 
Fig, 11 is a block diagram illustrating an object-based 
coding of image signals in accordance with the present invention; 
5 Figs. 12A and 12B are block diagrams respectively 

i!l lustra ting different embodiments of a shape-adaptive scanning 
part according to the present invention; 

Fig. 13 is a block diagram illustrating an object-based 
1^ image signal decoder according to the present invention; 

1^=5 10 Fig. 14 is a block diagram illustrating an object decoding 

■^j part according to the present invention; 

Fig. 15 is a block diagram illustrating an apparatus for 
Li object-based decoding of image signals in accordance with the 

1^ present invention; and 

Figs. 16A and 16B are block diagrams respectively 
illustrating different embodiments of a shape-adaptive inverse 
scanning part according to the present invention. 



^ DESCRIPTION OF THE PREFERRED EMBODIMENTS 
20 

P Figs. 9 to 11 illustrate respective object-based image 
signal coding systems to which the present invention is 

"21- 



11-ie 17:3a WED FROM: PHOENIX INTEI 



82-2-555-1377 



TO: 54; 




PPGE:22 



■ i t. 
4? 

15 



applicable. Fig. 9 is a block diagram illustrating a general 
object-based image signal coding system. This system is adapted 
to divide an input image signal into object each having arbitrary 
shape information and to carry out a coding operation for each of 
the object- An input image signal is first applied to an object 
formation part 1 included in the objected-based image signal 
encoder- In the obiiect formation part 1, the input image signal 
is divided into each object. The object formation part 1, then 
derives shape information and texture information for each 
object. The resultant signals for each object are applied to an 
object coding part 2 which/ in turn, conducts a coding operation 
for those signals. This coding operation of the object coding 
part 2 is sequentially carried out for all objects (2-i, 2-2, 
and 2-n) . Outputs resulting from the object coding for all 
objects, namely, bitstreams are then multiplexed in a 
multiplexer (MUX) which, in turn, sends the resultant signal to 
a receiver or storage media. 



Fig. 10 illustrates the configuration of an object coding 



unit included in the object coding part 2 of Fig. 9. Although the 
object coding part 2 is shown in Fig, 9 as consisting of a 
plurality of object coding units^ it practically includes a 
single object coding unit which repeatedly performs a coding 
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operation by n times (2-1, 2-2, and 2-n) for n objects. 

Signal information of each object, which is inputted at the 
object coding unit, are divided into shape information and 



information are first inputted in a shape information coding part 
20 and a motion estimation part 21, respectively. 

The shape information coding part 20 serves to encode the 
shape information of the associated object. The resultant 
reconstructed shape information is then applied to a motion 
estimation part 21, motion compensation part 22 and a texture 
information coding part 24- Thus, the operation of each part is 
carried out on an object basis. Meanwhile, a shape information 
bitstrea-m, which is another output from the shape information 
coding part 20, is inputted to a multiplexer 25. 

The reconstructed shape information controls motion 
estimation, motion compensation, texture information coding. In 
order to control a decoding apparatus in the same way as above, 
the reconstructed shape information of an encoder should be 
coincide with a reconstructed shape information in the form of 
shape information bitst reams received by the decoding apparatus. 
On the other hand, m case that lossless coding is carried out in 
the shape information coding part, the reconstructed shape 



texture information . 



These shape information and texture 
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information is identical with the input shape information. In 
case of lossy coding, the reconstructed shape information is 
different from the input shape information. Therefore, 
controlling process for object-based coding of image signal is 
5 perforxned by using not the input shape information but the 
reconstructed shape information- The shape information 
disclosed hereinafter is reconstructed shape information unless 
otherwise noted. 

The motion estimation part 21 serves to estimate motion 
10 information of the texture information of the current object 
Q using the texture information of the current object and the 

U texture information of the previous object stored in a previous 

u, reconstructed object information memory 27. The motion 

:£r information is input to the motion compensation part 22 for a 

15 motion compensated prediction. The estimated motion 

information is efficiently encoded and then the resultant motion 
information bitstream is input to the multiplexer 25 . The motion 
compensation part 22 carries out amotion compensated prediction 
using the motion information derived by the motion estimation 
20 part 21 and the previous reconstructed object texture 
information stored in the previous reconstructed object 
information memory 27, 
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A subtracter 23 calculates a prediction error, namely, a 
difference between the input texture information and the jnotion 
compensated prediction texture information derived by the motion 
coTTipensation part 22. The resultant signal from the subtracter 
23 is encoded in the texture information coding part 24. The 
resultant texture information bitstream from the texture 
information coding part 24 is applied to the multiplexer 25 and 
the reconstructed prediction error signal is applied to an adder 
26 _ This adder 26 adds the reconstructed error signal to the 
motion compensated prediction signal, thereby generating a 
reconstructed texture inforniation signal of an associated object . 

This reconstructed texture information signal is stored in the 
previous reconstructed object information memory 27 so that it is 
used for coding of an object to be subsequently inputted. 

Using the reconstructed shape information received from the 
shape information coding part 20, the texture information coding 
part 24 encodes the texture information of an associated object . 

In the texture information coding part 24, the coding operation 
:ls not carried out for entire object, but carried out on a block 
basis which is pixel set having a certain size, for example, a 
MxN size* 

Meanwhile, although the texture information coding part of 
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Fig , 1 0 is illustrated as being adapted to encode prediction error 
signals, it may be possible to encode input texture inf oinaation 
in place of such prediction error signals. In this regard, it is 
possible to achieve an improvement in coding efficiency by 
adaptively encoding a selected signal enabling more efficient 
coding thereof out of the prediction error signal and texture 
information signal. For example, where motion information 
estimation is inaccurately carried out, the resultant prediction 
error signal has an increased value. In this case, accordingly, 
it is preferred that the input texture information be encoded, 
because a smaller number of bits are generated. Where coding of 
input texture information is carried out; it is unnecessary to use 
an adder operation for adding the reconstructed texture 
information to the prediction signal. Therefore, the coding 
part generally includes a control unit for determining a suitable 
mode and carrying out a control based on the determined mode, even 
though not shown in Fig, 10, 



Y fig- 11 illustrates an apparatus for obj ect-based coding of 
image signals in accordance with the present invention. This 
apparatus corresponds to the texture information coding part (24 ) 
of Fig, 10. As shown in Fig. 11, the object-based coding 
apparatus for image signals according to the invention 
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comprises ; 

I a shape information coding part for encoding shape 
information of an input image signal ; 
\ a shape-adaptive transform part for carrying out a shape- 
5 adaptive transform for texture information of sa.id input image 
signal, based on said shape information outputted from said shape 
information coding part; 
S P ] a shape-adaptive scan control part for forming a binary 
coefficient mask having the same transform coefficient 
m 10 distribution as that of an output signal from said shape-adaptive 
Q transform part ^ and generating a scan control signal in 

;y, accordance with existence or nonexistence of a transform 

;U, coefficient based on said binary coefficient mask; and 

^ \ a shape-adaptive scanning part for carrying out a scanning 
15 operation for an output from said shape-adaptive transform part^ 
based on the associated control signal from said shape-adaptive 
scan control part, 

^ The shape-adaptive scan control part 24 0 of the object- 
based coding apparatus comprises: 
20 p ^ a coefficient forming unit 241 adapted to form a binary 
coefficient mask for sorting segments containing transform 
coefficients from segments containing no transform coefficient 
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which has the saine transform coefficient distribution as that of 
an output signal from said shape-adaptive transform part; and 
P ^ a control signal generation unit 242 adapted to generate a 
skip signal for skipping segments containing no transform 
I coefficient from the scanning operation of said shape-adaptive 
scanning part . 

P The shape-adaptive scan control part 2 40 receives 
reconstructed shape information from the shape information 
coding part 20 of Fig. 10, thereby generating a control signal for 
10 sorting segments containing transform coefficients from 
Q segments containing no transform coefficient so as to control a 

1^ scanning operation in such a manner that the segments containing 

transform coefficients are scanned in a scan order while the 
jp segments containing no transform coefficient are excluded fioia 

m 

15 the scan order, 

p The coefficient forming unit 241 is adapted to transform the 
input reconstructed shape information in the same manner as in a 
shape-adaptive transform coding, thereby forming a coefficient 
mask which denotes a region of segments having a transform 

20 coefficient (transform coefficient region) so as to sort segments 
containing transform coefficients from segments containing no 
transform coefficient. The scan control signal generation unit 
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20 



242 serves to scan the coefficient mask in the same manner as in 
the scanning of transform coefficients and to generate a signal 
indicative of whether or not the currently scanned mask 
corresponds to the transform coefficient region. 



Y The apparatus further includes a shape-adaptive scanning 
part 245 which scans quantized coefficients contained in the 
segments containing transform coefficients while excluding the 
segments containing no transform coefficient, thereby skipping 
them, in response to the control signal generated from the 
shape-adaptive scan control part 240, 

The shape-adaptive scanning part (245) according to the 
present invention also receives transform coefficients 
outputted from a shape-adaptive transform unit (243) and 
conducts a scanning operation for arranging those transform 
coefficients in a one-dimensional array. During the scanning 
operation, the shape-adaptive scanning part receives a control 
signal - a signal indicative of whether or not the currently 
scanned segment contains an associated transform coefficient - 
from the shape^adaptive scan control unit, in order to exclude 
segments containing no transform coefficient from the scan order, 
namely, to prevent zero coefficients of those segments from being 
included in the one-dimensional array. 
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In other embodiment: of the present invention, the shapes- 
adaptive scanning part 245 comprises: 

P I a scanning unit 245-1 adapted to scan the entire segment 
including segments containing shape-^adapt ive transform 
5 coefficients and segments containing no transform coefficients 
Jbut respectively filled with coefficients of a predetermined 
value; and 

:5 P J Si switching unit 245-2 adapted to receive an output signal 

from said scanning unit and to switch off said output signal from 
,m 10 said scanning unit, based on said skip signal from said control 
y signal generation unit, when said output signal is associated 

[=i with a segment containing no transform coefficient. 

Y In accordance with the present invention, therefore, it is 
■•iQ possible to reduce the number of zero coefficients unnecessarily 

15 inserted irrespective of non-existence of transform 
coefficients in the case of the conventional scanning methods- 

This results in an advantage of an improvement in coding 
efficiency. 

P Now, the operation of the object-based image signal coding 
20 apparatus of Fig. 11 according to the present inv-ention, which 
corresponds to the texture information coding part 24 of Fig. 10/ 
will be described in detail. When a boundary block as shown in 
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Fig, 4 is inputted at the input stage of a shape-adaptive 
transform unit 243, it is processed by the well-known shape- 
adaptive transform, so that the shape-adaptive transform unit 
243 outputs shape-adaptive transform coefficients . In thxs case, 
5 the texture information signal inputted at the shape-adaptive 
transform unit 243 may be a prediction error signal as used in the 
case of Fig. 10. Alternatively, an input texture information 
signal may be inputted where the prediction error signal has a 
large value. Such an input mode selection has no direct relation 
10 with the present invention. The shape-adaptive transform unit 
y 243 also receives reconstructed shape information outputted from 

U the shape information coding part 20 of Fig. 10 in order to 

,1^ determine which pixels correspond to object pixels. The number 

irt of transform coefficients outputted from the shape-adaptive 

15 transform unit 243 is equal to the number of object pixels. 
Where the transform coding used is the shape-adaptive DCT , the 
transform coefficients are arranged in a manner as described in 
con:iunction with Fig, 5. Referring to this example, it can be 
found that the transform coefficients outputted from the 
20 shape-adaptive transform unit 243 have a different arrangement 
from the shape information inputted at the same unit 243. 
Accordingly, it is necessary to change the arrangement of the 
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input shape infonaation so that it is identical to that of the 
transform coefficients. This arrangement change is carried out 
in the coefficient mask forming unit 241 , This will be described 
m niore detail- The input of the coefficient mask forming unit 
241 is the input shape information whereas the output of the same 
unit 2 41 is shape information having an arrangement identical to 
the arrangement of the transform coefficients outputted from the 
shape-adaptive transform unit 243. That is, the coefficient 
mask forming unit 241 forms a coefficient mask for determining 
whether or not the currently scanned segment contains an 
associated transform coefficient. The coefficient mask output 
from the coefficient mask forming unit 241 is applied to the scan 
control signal generation unit 242 via an output stage thereof. 

Based on such shape information, the scan control signal 
generation unit 242 controls the shape-adaptive scanning part 



Y The transform coefficients from the shape^adaptive 
transform unit 243 are applied to a quantization part 244 which, 
in turn, carries out a quantization for the received trai^sform 



transmitted to the shape-adaptive scanning part 245 which, in 
turn; arranges the received transform coefficients in a one- 
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dimensxonal array. The transform coefficients arranged in a 
one-dimensional array are applied to a variable-length coding 
part (VLC) 246 which, in turn, conducts a coding operation for the 
received transform coefficients, thereby outputting an 
associated bit stream. In the case of the well-known scanning 
methods, a transforit* coefficient scanning operation is performed 
for the entire segment of a block, as shown in Figs. 7A to 7C, In 
the shape-adaptive transform, however, only the transform 
coefficients respectively associated with pixels included in the 
object region are transmitted. In this case, the arrangement of 
the transform coefficients outputted from the shape-adaptive 
transform unit 243 or quanti zation part 244 is changed depending 
on the shape information. Accordingly, the control signal 
generation unit 242 generates a signal indicative of whether or 
not the currently scanned mask region corresponds to the 
transform coefficient region, based on the shape information 
outputted from the coefficient mask forming unit 241, while 
conducting its scanning operation in the same manner as in the 
shape-adaptive scanning part 245, based on the shape information 
outputted from the coefficient mask forming unit 241, As 
mentioned hereinbefore, the shape information outputted from the 
coefficient mask forming unit 241 has the same arrangement as that 
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of the transform coefficients outputted from the shape-adaptive 
transform unit 243, Therefore, the scan control, which is 
carried out based on such shape information, makes xt possible to 
effectively eliminate unnecessary information possibly 
generated in the shape-adaptive transform coding. Thus, there 
is an advantage of an improvement in coding efficiency. 



Y Figs. 12A and 12B illustrate embodiments of the shape- 
adaptive scanning part 245 according to the present invention, 
respectively. In the case of Fig. 12A, the shape-adaptive 
scanning part 245 includes a scanning unit 245-1 and a 
switching unit 245*-2. The shape-adaptive scanning unit 245-1 
is configured to operate in the same scanning manner as in the 
conventional scanning method of Figs^ 7A to 7c. The switching 
unit 245-2 serves to carry out its switching operation in 
accordance with a control signal received from the shape- 
adaptive scan control unit 245-1. Where the control signal 
applied to the switching unit 245-2 is indicative of a segment 
containing no transform coefficient , the switching unit 245-2 is 
switched off. The switching unit 245-2 is also switched on when 
the control signal applied thereto is indicative of a segment 
containing a transform coefficient. In accordance with such an 
operation of the switch controlled in response to the control 
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signal, the shape-adaptive scanning part generates its output 
only for segments containing transform coefficients. This will 
be described in more detail in conjunction with Fig, 8C- 
Assuming that the scanning method used is a ::ig-^ag scanning 
S method, the shape^adaptive scanning part outputs Xll, X12, X21, 
X31, X22, X13, 0, 0, X41, X51, 0, 0, 0, Xl5, X16, 0, 0, 0, 

X52, and X71- The control signal generation unit of the 
*2 shape'-adaptive scan control part, which receives the transform 

•fl coefficient position information as shown in Fig. BC, scans all 

10 segments in the same order as in the zig-zag scanning carried out 
C: iri the shape-adaptive scanning. When the control signal 

-L^ generation unit scans a segment containing a transform 

coefficient, it generates a control signal for switching on the 
switch. 

15 p The control signal generation unit 242 also outputs a 
control signal for switching off the switching unit 245-2 when 
it scans a segment containing no transform coefficient- Thus, 
the switching unit 245*2 outputs Xll, X12, X21, X31, X22, X13, 
X14, 0, X41, X5l, 0, X15, X16, X52, and X7 1 whxle receiving inputs 
20 of Xll, X12, X2I, X31, X22, X13, X14, 0, 0, X41, X51, 0, 0, X15, 
X16, 0, 0, 0, X32, and X7l. 
P On the other hand, the object-based image signal coding 
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apparatus shown in Fig, 12B includes a shape-adaptive scanning 
part 245 configured to control its scanning operation by a control 
signal, as compared to the case of Fig- 12A in which the 
object-based image signal coding apparatus includes a scanning 

5 Linit 245-1 configured to operate in the same scanning manner as 
m the conventional scanning methodr and a switch controlled by 
a control signal. In the case of Fig. 12B, a new scanning scheme 
is defined and used- That is, the shape-adaptive scanning part 
of Fig, 12B itself operates to skip segments containing no 

0 transform coefficient while basically operating in the same 
manner as in the conventional scanning method. Assuming that 
this shape-adaptive scanning part 245 basically operates in a 
zig-zag scanning fashion and receives the transform coefficient 
position information as shown in Fig. BC, it carries out a 

5 scanning operation in accordance with a new scanning scheme shown 
in Fig. 8D, in response to a control signal applied thereto- The 
shape-adaptive scanning part245 of Fig. 12B may also basically 
use the scanning scheme as shown in Fig . 7B or 7c . Thus, the 
scanning scheme intended in this embodiment may be detei-mined in 

0 accordance with the input shape information and the basic 
scanning scheme used. Of course^ both the embodiments of Figs. 
12A and 12B provide the same result where the same input shape 
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infortnation and the same basic scanning scheme are used. 
P Although not shown in Fig. 11 and Fig. 12, the texture 
infortnation coding part should include a unat adapted to 
reconstruct an encoded texture information signal. Generally, 
this unit carries out an inverse quantization procedure and an 
inverse transform procedure- The resultant reconstructed 
texture information signal is applied to the adder of Fig. 10. 

P Figs. 13 and 14 illustrate an object-based image decoding 
system in accordance with the present invention. Fig. 13 
Illustrates a block diagram schematically illustrating an 
object-based image decoding system according to the present 
invention. A bitstream, which is received in the object-based 
image decoding system, is divided into bitstreams respectively 
associated with objects. The resultant object bitstreams are 
15 decoded in an object decoding part 32 in association with objects, 

respectively. The resultant reconstructed object signals from 
the object decoder 32 are composed by a composition part 33, 
thereby generating and displaying a single image signal . 

P Fig. 14 is a block diagram illustrating a detailed 
20 configuration of the object decoding part 32 according to the 
present invention. Although the object decoding part 32 is shown 
in Fig. 13 as consisting of a plurality of object decoding units. 
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xt practically includes a single object decodi.ng unit which 
repeatedly performs a decoding operation by n times (32-1, 32- 
2, and 32-n) for n objects. The illustration of Fxg, 13 i$ 



decoding part 32 for objects, A bitstream, which is received in 
the object decoding part 32, is demultiplexed into a motion 
information bitstream, a shape information bitstream, and a 
texture information bitstream via a demultiplexer (DEMUX) 41. 

The separated bitstreams are then applied to decoding parts 42 
to 44, respectively. The shape information decoding part 43, 
which receives the shape information bitstream, generates 
reconstructed shape information. This reconstructed shape 
information is applied the texture information decoding part 44 . 

The reconstructed shape information is also applied to a motion 
compensation part 45* Thus, decoding is carried out for each 
object. That is, reconstruction of pixels only included in the 
object region is possible. The texture information decoding 
part 44 receives the texture information bitstream, thereby 
conducting a texture information decoding operation. In order 
to decode only the texture information associated with the object 
region, the texture information decoding part 44 also receives 
the reconstructed shape information and uses it upon decoding the 



only to emphasize individual decoding operations of the object 
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texture information. The motion information decoding part 42 
receives the motion information bitstream, thereby conducting a 
motion information decoding operation. The motion compensation 
part 45 carries out a motion compensated prediction, based on the 
5 motion information outputted from the motion information 
decoding part 42 and the previous texture information from a 
previous reconstructed object memory part 46, Of course, the 
operation of the motion compensation part 45 is carried out only 
ijj in association with the object region. To this end/ the 

yj 1.0 reconstructed shape information outputted from the shape 
y information decoding part 43 is also applied to the motion 

compensation part 45. This reconstructed shape information is 
identical to the reconstructed shape information outputted from 
the shape information coding part of Fig. 10. A motion 
15 compensated prediction signal outputted from the motion 
compensation part 4 5 is added to the reconstructed texture 
information from the texture information decoding part 44 in an 
adder 47, thereby recovering the associated object. The 
recovered object is stored in the previous reconstructed object 
20 memory 4 6 so that it is subsequently used upon decoding of the next 
frame. The recovered object is also applied to a composition 
part so that it is composed with other objects, thereby 
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reproducing an image signal. 

Fig. 15 is a block diagram illustrating an apparatus for 
shape-adaptive decoding of image signals in accordance with the 
, present invention. This apparatus corresponds to the texture 

5 information decoding part 44 of Fig. 14. As shown in Fl'G. 15, the 
object-based decoding apparatus for image signals according to 
the invention comprises: 
i|j P i( a shape information decoding part for decoding shape 

.if] information associated with objects and contained in an object 

|ji 10 bitstream transmitted from a coding apparatus; 

^•ij iP j a shape-adaptive inverse scan control part 4 40 for forming 

:K= a binary coefficient mask, based on said shape information 

? : 

:[=>. received from said shape information decoding part, and 

sij generating an inverse scan control signal in accordance with 

IS existence or nonexistence of the coefficient mask; 

a shape-adaptive inverse scanning part 444 for performing 
an inverse scanning operation to arrange transform coefficients 
of texture information contained in said object bitstream in the 
form of a two-dimensional signal^ based on said inverse scan 
20 control signal from said shape-adaptive inverse scan control 
part; and 

p I a shape-adaptive inverse transform part 446 for performing 
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a shape-adaptive inverse transform for the transform 
coefficients inversely scanned by said shape-adaptive inverse 
scanning part, based on said decoded shape information outputted 
from said shape information decoding part, thereby 
5 reconstructing texture information of an original image. 

P The apparatus includes a shape-adaptive inverse scan 
control part 440 for receiving reconstructed shape information 
outputted from a shape information decoding part 43, thereby 
■-"^ generating a control signal for sorting segments containing 

2j 10 transform coefficients from segments containing no transform 
coefficient so as to control an inverse scanning operation in such 
x,^ a manner that the segments containing transform coefficients are 

:Lv scanned in the well-known scan order while the segments 

.!H containing no transform coefficient are excluded from the scan 

1 5 order . 

The shape-adaptive inverse scanning part 444 of the 
apparatus which inversely the segments containing transform 
coefficients while excluding the segments containing no 
transform coefficient, in response to the control signal 
20 generated from the shape-adaptive inverse scan control part 44 0, 

P The shape-adaptive inverse scan control part 44 0 operates 
in the same manner as the shape-adaptive scan control part 240 of 
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F±g. 11. That is, the shape-adaptive inverse scan control part 
440 includes a coefficient mask forming unit 4 41 adapted to 
transform the input reconstructed shape information in the same 
manner as in the shape-adaptive transform coding, thereby 
forming a coefficient mask which denotes a region of segments 
havi ng a transform coefficient (transform coefficient region) so 
as to sort segments containing transform coefficients from 
segments containing no transform coefficient, and a control 
signal generation unit 442 adapted to scan the coefficient mask 
In the same manner as in the scanning of transform coefficients 
and to generate a signal indicative of whether or not the 
currently scanned mask segment corresponds to the transform 
coefficient region- 



The shape-^adaptive inverse scanning part 444 according to 
the present invention also receives transform coefficients 
outputted from a variable-length decoding unit 44 3 and conducts 
a inverse scanning operation for arranging those transform 
coefficients in the form of a two-dimensional signal . During the 
inverse scanning operation, the shape"adaptiv;'e inverse scanning 
part 444 receives a control signal - a signal indicative of 
whether or not the currently scanned segment contains an 
associated transform coefficient - from the shape-adaptive 
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inverse scan control unit 440, in order to skip segments 
containing no transform coefficient from the scan order. In 
accordance with the present invention, therefore, it is possible 
to decode the bitstreams generated by way of reducing the nuiTiber 
of zero coefficients unnecessarily inserted irrespective of 
non-existence of transform coefficients in the case of the 
conventional scanning methods. 

In accordance with an embodiment of the present invention 
shown in Fig. 16A, the shape-adaptive inverse scanning part 444 
10 xs configured so that during its scanning of segments processed 
by the variable-length decoding^ it switches off outputtxng of 
scanned transform coefficient values associated with segments 
containing no transform coefficient, based on a skip signal from 
the control signal generation unit 442. In accordance with 
15 another embodiment of the present invention shown in Fig* 16B, the 

shape-adaptive inverse scanning part 4 44 is configured so that 
daring its scanning of segments, it excludes segments containing 
no transform coefficient from the scan order, thereby skipping 
them, based on a skip signal from the control signal generation 
20 unit 442. 

P In operation of the apparatus, a variable-length decoding 
part 443 receives a bitstream of texture information, thereby 
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outpatting transform coefficients arranged jltx a one-dimensionai 
array. The shape-adaptive inverse scan control part 440 nas the 
same configuration as the shape-adaptive scan control part of Fig. 
11 . The coefficient mask forming unit 441 outputs a coefficient 
5 mask for determining whether or not the currently scanned segment 
contains an associated transform coefficient* This information 
IS applied to the control signal generation unit 442 which, in 
turn, outputs a control signal indicative of which segments have 
no transform coefficient while inversely scanning the entire 

10 segment in the same manner as in the shape-adaptxve inverse 
scanning part 444 - The shape-adaptive inverse scanning part 444 
conducts a procedure for re-arranging transform coefficients 
outputted from the variable-length decoding part 44 3. 
Thereafter, a dequantization for the transform coefficients is 

15 carried out in a dequanti^ation part 445. The resultant 
transform coefficients are inversely transformed in a shape- 
adaptive inverse transform unit 44 6, thereby reconstructing 
texture information. 



20 the present invention will be exemplarily described in 
conjunction with Fig. 8C. The variable-length decoding part 443 
outputs Xll, X12, X21, X31, X22, X13, X14, 0, X41, X51, 0, X15, 



The shape-adaptive inverse scanning procedure according to 
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X16, 0, X52, and X71 whereas the shape-adaptive inverse scanning 
part 44 4 generates outputs as shown in Fig. BE. In Fig. 8E, the 
bright portions correspond to segments containing no transform 
coefficient. These segments are not subject to an object-based 
b decoding. Even when these segments are filled with arbitrary 
values, the decoding part is not in fluenced by them- The mvers.e 
scanning unit 444*1 of Fig. 16A is configured to operate in the 

'. 1 

same scanning manner as in the conventional scanning method while 
:iQ using a switching unit 444-2 controlled by a control signal. 

ID 10 On the other hand, the shape-adaptive inverse scanning part of 
y Fig. 16B uses a new inverse scanning scheme as shown in Fig. 8D. 

[=i= The inverse scanning procedure according to the present 

— 

M.- invention may be carried out using a zig-zag scanning scheme or 

.:0 other scanning schemes* 

m 

15 As apparent from the above description, the present 

invention provides object-based coding and decoding apparatuses 
and methods fox image signals, wherein upon scanning shape- 
adaptive transform coefficients of blocks transformed in 
accordance with a shape^adaptive transform, only segments 

20 containing such shape-adaptive transform coefficients are 
scanned. In the scanning operation, segments containing no 
transform coefficient are skipped. As a result, it is possible 
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to suppress transmission of unnecessary bits. Accordingly, 
there are redundant bits which can be used for an xmprovement in 
picture quality. This results in an improvement xn the quality 
of image services. 

Although the preferred embodittients of the invention have 
been disclosed for illustrative purposes, those skilled in the 
art will appreciate that various modifications, additions and 
substitutions are possible, without departing from the scope and 
spirit of the invention as disclosed in the accompanying claims. 
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